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Abstract — Human eyes are the best evaluation model for 
assessing the image quality as they are the ultimate receivers 
in numerous image processing applications. Mean squared 
error (MSE) and peak signal-to-noise ratio (PSNR) are the 
two most common full-reference measures for objective 
assessment of the image quality. These are well known for 
their computational simplicity and applicability for 
optimization purposes, but somehow fail to correlate with the 
Human Visual System (HVS) characteristics. In this paper a 
novel HVS based perceptual quality estimation measure for 
color images is proposed. The effect of error, structural 
distortion and edge distortion have been taken in account in 
order to determine the perceptual quality of the image 
contaminated with various types of distortions like noises, 
blurring, compression, contrast stretching and rotation. 
Subjective evaluation using Difference Mean Opinion Score 
(DMOS), is also performed for assessment of the perceived 
image quality. As depicted by the correlation values, the 
proposed quality estimation measure proves to be an efficient 
HVS based quality index. The comparisons in results also 
show better performance than conventional PSNR and 
Structural Similarity (SSIM). 

Index Terms — PSNR, HVS, RGB color model, Quality Measure 
(g), Subjective Evaluation, DMOS. 

I. Introduction 

Although the field of digital image processing is built on 
the foundation of mathematical formulations, yet human 
intuition and analysis plays a central role in the choice of one 
technique over another [ 1 ] . The visual quality of a color image 
is adjudged in the best way according to the look and feel of 
the image by the human visual system and hence it has 
become a major platform for the quality evaluation of color 
images. Distortions are introduced in an image during the 
process of storage, reconstruction, compression and 
enhancement. Therefore, assessment of quality is a crucial 
task in image processing applications [2]. Objective evaluation 
models use the mathematical expressions for assessment of 
image quality while the subjective models are based on 
physiological and psychological perception of human. 
Subjective models, evaluate the quality of the image as 
perceived by an individual observer. The features of both 
these models are incorporated in the HVS model that 
correlates well with the perceived image quality. The scope 
of conventional HVS based evaluation model is limited, as 



they consider error sensitivity as the only parameter for 
assessment of image quality [3]. The conventional indexes 
of quality assessment MSE and PSNR are operationally simple 
and have clear physical meaning but are unable to assess the 
similarity between different distortion types [4]. Compatibility 
of SSIM [5] with HVS characteristics accounts for its wide 
applicability, yet the performance of this metric degrade for 
poor quality and high texture images. Apart from its 
computational complexity (in comparison to MSE), SSIM is 
also not efficient for relative translations, scaling and rotation 
of images [4], [6]. Eric Wharton etal. [7] included Michelson 
contrast and MSE for making their proposed metrics more 
compatible to HVS. But their metrics does not account for 
structural and edge changes which are mainly noticed by 
human eyes. Wan Yang et al. [8] used a method of image 
quality assessment based on Region of Interest (ROI) and 
structural similarity. They had modified classical SSIM by 
using circular symmetric Gaussian weighting function and 
used gradient operator to enhance the performance of their 
metric. But their metric does not account for the edge 
modifications in the image which are mainly noticed by human 
eyes. Wei Fu et al. proposed a similarity index [9] for color 
images and used edge, luminance and structural similarity 
for the assessment of quality. However their model neglects 
the effects of other color image components like contrast 
that give information about the visual quality of image. Bo 
Wang et al. in their quality index [10] employ the HVS 
characteristics both in frequency and spatial domain. Ho- 
Sung Han et al. [11] used the gradient information for the 
assessment of image quality. The concept used in their work 
has been considering only the effect of large differences 
between the pixels of the original and distorted images. 
However, distortions projecting small differences in the pixels 
are neglected. Recently, Chen Yutuo et al. proposed an 
evaluation method for coding color images [12] based on the 
HVS model. Image pixels, region construction and edges are 
used as evaluation parameters in their work. The simulations 
performed by the authors have considered only the limited 
set of distortions, being silent about the effect of different 
noise types, rotation, blurring etc. Many objective 
evaluations proposed in the literature are at times proved 
complex and could not compete over the conventional PSNR 
[13]-[ 15]. Although, it is true that images with higher values 
of PSNR do not often yield good visualization by human 
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observers. They are limited in approach to assess over 
enhancements, blurring effects and weak edges which are 
the primary outcomes of processing by sharp enhancement 
or denoising filters. This paper proposes a full-reference 
perceptual quality estimation measure for color images 
incorporating the known characteristics of the HVS. The 
proposed evaluation model provides an objective assessment 
of the image by taking into account the error sensitivity, 
structural distortion and edge distortion. It uses the RGB 
model for color images and empirically combines the above 
effects on each of the color plane. The remaining part of this 
paper is structured as follows: Section II describes the method 
for estimation of degree of distortions and the proposed 
perceptual quality estimation measure. Details of the 
experimental procedure and the obtained results are discussed 
under section III. Finally the conclusions are drawn at the 
end. 

U. Proposed Evaluation Model 

Image degradations can be modeled as losses in the 
perceived structural content in addition to the error sensitivity 
estimation (as in Minkowski error metric [16]). There are still 
numerous structural changes which cannot be captured by 
the above estimators; one of them is edge distortion, a 
primary outcome of the images restored by sharp non-linear 
filters removing high density noise contaminations at the 
cost of weak edges and losses of finer details from the image. 
The motivation for our work is to develop a more precise 
evaluation framework for degraded images by modeling 
distortion in terms of error sensitivity along with structural 
and edge distortions for quality measurement. The proposed 
full-reference image quality measure (0, performs evaluation 
as the weighted sum of the above mentioned distortions (i.e. 
error-sensitivity, structural and edge distortions) calculated 
for each of the R, G, B color planes separately. Figure 1 shows 
the block diagram for the proposed methodology for 
estimation of distortion in color images. 

A. Measurement of Error 

The distortion introduced in the image changes the pixel 
gray value which is mainly noticed by the HVS [12]. Thus, 
the error introduced in the three color components is 
calculated separately for quality measurement. If x( denotes 
the reference image and y( the distorted image, then the 
error introduced in the R component is calculated as: 



MN ~! „ 



j)-}HJ)] 



(1) 



where: i & j are the pixel positions of the M x N image. Similarly, 
E and E b are the error in G and B components, calculated as 
in (1). Overall error is estimated by average of the error for R, 
G and B components and hence, PSNR £ (dB) due to error is 
given as: 



PSNR =10 log 



[3/(E r+ E g+ E b )] 



(2) 
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B. Measurement of Structural Distortion 

Human eyes mainly extract the structural changes from 
the viewing field, so structural distortion is an important 
parameter for quality assessment. Measurement of this 
distortion in the proposed work is performed by dividing the 
image in equal size PROPOSED QUALITY METRIC and 
non overlapping square regions, along with the calculation 
of the mean, maximum and minimum pixel values in each region. 
As it is known that the maximum and the minimum pixel values 
decide the contrast level of the region, thus the proposed 
measure also estimates the contrast change in the distorted 
image and hence can be used to evaluate the quality in 
coherence with HVS. Structural distortion S , S and S, for the 

r g b 

three color components R, G and B respectively can be 
calculated as: 

S r =-^X{°- 5 [ Xa i ~ Y "< Y+°- 25 [ x P < -Yp.] 2 +0.25[Xb -Fi ] 3 j (3) 

where: Xa.Xp.Xb. and Ya, Yp, Yb. denote the mean, maximum 
and minimum pixel values for the reference and the distorted 
image respectively. N is the number of regions in which the 
image is divided. The overall structural distortion is the mean 
of the structural distortion of the three color components 
and hence PSNR S (dB) of the structural distortion is given 
as: 



PSNR S =Wlog 10 [3/ (S, + S g +S t )] 



(4) 



C. Measurement of Edge Distortion 

Edges denote the sites where there is an abrupt change 
in the pixel value or texture. A distorted image with very similar 
edges to the reference image gives a very high perceptual 
quality for HVS, although PSNR and SSIM produce an 
opposite result [9]. Canny edge detection algorithm [17] is 
used in this work as it is well-known for its large values of 
signal-to-noise ratio and high precision. The edge distortion 
for R component is given as: 



MN 



(5) 



where: x(i,j) and y (i,j) denotes the original and distorted 
edge maps of the image. Similarly, ED and ED b can be calcu- 
lated for G and B component. Hence the overall PSNR £D (dB) 
of the edge distortion can be given as: 

PSNR m =l0log 10 [3 / (ED + ED + ED b )] 
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D. Proposed Quality Estimation Measure 

The proposed quality measure (Q) in dB is the 
weighted sum of different PSNR (in dB) components based 
on error, structural and edge distortion obtained from (2), (4) 
and (6) respectively. 

Q = aPSNR £ + $PSNR m + yPSNR s (7) 

where: a, ft, and y coefficients have different values, empirically 
determined for different types of distortions. Introduction of 
different coefficients in (7) is being done as each type of 
distortion has a different effect on error, structural and edge 
distortion respectively. Thus, these variable weights make 
the proposed quality measure a more sensitive and versatile 
towards specific type of distortions. In order to make the 
proposed measure distortion specific, distortions are divided 
into 3 categories. Distortions specific to noise attacks are 
grouped under category-I. Contrast distortions and 
degradations due to rotation are considered under the 
category-II where as category-Ill groups the blurring and 
compression artifacts. The quality measure (Q) in dB can be 
defined as per the given matrix: 



Q, 
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(8) 



where: Q p Q and Q are the quality measure in dB for the 
distortion category-I, II and III respectively. In case of 
category I, noises contaminations deform the edges more 
severely than the others factors in the image. So, a higher 
coefficient is assigned to the PSNR component of edge 
distortion. The others two factors have an average affect on 
the image. Category-II considers contrast change and rotation 
in the image that only modifies the pixel values without 
causing any noticeable edge and structural distortion. Hence, 
a comparatively higher coefficient is assigned to the PSNR 
component for error sensitivity unlike category I. Category- 
Ill includes blurring and compression, which causes large 
structural modification in the image. This justifies for the 
choice of the higher coefficients for the PSNR component of 
error and structural distortion respectively. A generalized 
version of the proposed quality measure known as (g ) in dB 
is given in (9), which is independent of the distortion type. 

ft, =0.32PSNR +03SPSNR +03PSNR (9) 

£ ED S v y 

III. Experimental Results and Discussion 

A. Experimental Procedure 

The input reference image used for the experiments in 
this work is standard Lena image of size 256 x 256. As shown 
in figure 1, the early transformations (like normalization, gray 
conversion etc.) are applied to the input image in the pre- 
processing block. Different types of distortions are then 
superimposed on the pre-processed image; these include 
noise contaminations (salt & pepper noise, speckle noise 
and Gaussian noise), blurring (motion & Gaussian blur), 
contrast change, compression and rotation. 
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Figure 2 shows the different simulated distortions applied 
to the pre-processed input reference image. The color image 
is then decomposed into its three components (R G & B color 
planes) for further processing. The PSNR component for error 
sensitivity, structural and edge distortions are then calculated 
for all the components of the image as described in (l)-(6). 
Finally, the obtained results are empirically combined in the 
mathematical combiner to yield the quality measure (Q) in dB 
as in (7)-(8), which specifically quantifies the effect of different 
types of simulated distortion. Table I gives the comparison of 
the obtained values of proposed measure (Q) in dB along 
with the conventional PSNR (dB) for each category of 
distortions. 



Table I. Evaluation results of conventional PSNR and proposed quality 
metric (Q). 
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Figure 2. Reference image simulated with different types of distortion, (a) - (c) Salt & Pepper noise, (d) - (f) Speckle noise, (g) - (j) 
Gaussian noise, (k) -(m) Contrast stretching, (n), (o) Rotation, (p) - (r) Gaussian blurring, (s) - (v) Motion blurring, (w), (x) Compression. 



B. Subjective Evaluation 

In this paper the efficiency of the objective quality measure 
is adjudged by the subjective evaluation model. In the 
process of subjective evaluation 42 images have been 
assessed upon their visual quality by a group of 150 
observers. These set of images have been distorted by 
varying levels of specified distortions. The quality scores 
given by the observers were recorded on a quality scale of 
to 1 (where means worst and 1 means best). These subjective 
scores were directly related to the quality of the image i.e. 
higher the score better is the visual quality of the image. 

C. Processing of Subjective Scores 

Let s denotes the subjective score assigned by the 
observer i to the image j. In this paper the subjective 
evaluation is based on the DMOS i.e. difference mean opinion 
score, which basically takes in account the difference between 
the scores of reference and the test image. So, the difference 
score d.. has been calculated by subtracting the subjective 
score assigned by the observer to the test image from the 
scores assigned to the reference image. 



- s •■ — s • ■ 



(10) 

The difference scores that are zero in the case of reference 
image have been removed for further processing. These 
difference scores are converted to theZ-scores [18] by using 
the following equations: 



N 



1 
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N -l ;=i 
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dy-Hi 



(11) 



(12) 



(13) 



Where N is the number of test images seen by the observer. 
These Z-scores are then linearly scaled between [0, 1] in 
order to develop a proper evaluation model. In our experi- 
ment all the Z-scores lie within the range of [-4, 5] . Hence 
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rescaling was accomplished by linearly mapping the range [- 
4,5]to[0, 1] using: 



(z.j + 4) / 9 



(14) 



Finally the Difference Mean Opinion Score (DMOS) has been 
calculated as the average of all the Z-scores for the respective 
image as: 



DMOS - 



1 M 

— I z' 

M f=l 



(15) 



where: M is the total no of observers in the subjective 
evaluation [19]. 

D. Comparison of Results 

In order to evaluate the performance of the proposed quality 
measure (Q), Pearson correlation coefficient is used as a tool to 
estimate the correlation of Q with respect to different HVS based 
metrics like Edge Performance Index (EPI), Structural Correlation 
(SC), Mean Absolute Error (MAE) [20], CONTRAST (c(x,y)) 
[2 1 ] , and DMOS. The results in table I show that there is a large 
difference in values of conventional PSNR as compared to Q, 
for the images with approximately same visual quality. It can be 
inferred from the results stated in table II that Q is more efficient 
in measuring the degradation for all the distortion categories as 
per the HVS characteristics. From the results stated in table III, it 
can be seen that Q in addition of being a better HVS based 
quality measure, also have the capability to assess specific types 
of distortions like edge, structure, contrast changes and error in 
the image as the results have very high correlation coefficients. 
All the stated results validate the effectiveness of proposed 
quality measure in measuring the degradation in the image for 
the various distortion types. The effectiveness of the quality 
measure Q can also be seen from the scatter plots shown in 
fig. 3, 4 and 5. In fig. 3(a), variation of the values of Q with the 
DMOS for noise contamination (category I) depicts that for 
higher values of Q the DMOS score is low i.e. the DMOS 
values decreases with the increase in the visual quality of 
the image because of lower noise contamination. The visual 
quality of the image degrades with the increase in the degree 
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(a) (b) (c) 

Figure 1 . Scatter plot of Q Vs DMOS for (a) Category I (b) Category IL (c) Category HL 



(a) (b) ( C ) 

Figure 2. Scatter plot of PSNR Vs DMOS for (a) Category I (b) Category II (c) Category IE. 





(a) 

Figure 3. Scatter plot of SSIM Vs DMOS for 

of distortions like compression, blurring, contrast change 
etc, which is also justified from the variation of Q shown in 
fig. 3 (b) and (c). For the same type and degree of distortion, 
the values of PSNR and SSIM have also been plotted in fig. 4 
and 5 but their values does not follow any regular patter of 
variation with the subjective DMOS score showing their 
inefficiency in evaluating the results as per the HVS 
characteristics. 

Table II. Pearson Correlation between different quality measures and 

SUBJECTIVE EVALUATION 
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Conclusion 

This paper presents a new perceptual quality estimation 
model for color images based on HVS. The proposed model 
accounts for all the types of degradations that severely affect 
the visual quality of the image. It evaluates the quality measure 
Q as weighted sum of PSNR components due to different 
distortions for each color planes. Different sets of weights have 
been used according to the category of the distortion and their 
values are based on the effect of the distortion on the visual 
quality of the image i.e. how it affects some of the common 
properties of the HVS like error, structural and edge information 
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(b) (c) 
(a) Category I. (b) Category II. (c) Category III. 

of the image. Weighted coefficients used in the quality measure 
also strengthen its quality measurement ability. The correlation 
coefficients calculated for the subjective evaluation results prove 
the efficiency of proposed quality measure and its consistency 
with the HVS characteristics. The simulation results also show 
strong correlation with several other well known distortion 
measures like EPI, SC, MAE and CONTRAST. 
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Table III. Pearson Correlation between different quality measures and EPI , SC, MAE and CONTRAST(c(x,y)) 
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